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DETAILED ACTION 

This office action is in response to tine Request for Continued Examination filed 
1 1/17/2008 and the After Final Amendment and Remarks filed 10/23/2008. 

Response to Arguments 

Applicant's arguments filed 10/23/2008 have been fully considered but they are 
not persuasive. Applicant contends the amendment overcomes the applied prior art: the 
applied reference Biocca does not teach or suggest "render[ing] the second image of 
the second, different physical location on a pair of displays that are integrated with the 
set of goggles." Applicant relies on Biocca's embodiment where screens 103 project the 
image and not in the headset worn by the user. This is not the only embodiment of 
projecting images to the user. Biocca further teaches wherein the headset comprises 
lens or displays to project the images to the eyes of the user. See the rejection below. 
Applicant has provided no citation for where "integrated with the set of goggles" has 
support in the original disclosure. The Examiner has interpreted the limitation in view of 
the disclosure as a pair of displays combined with the goggles/headset of the user. 
Claim Rejections - 35 USC § 103 

The text of those sections of Title 35, U.S. Code not included in this action can 
be found in a prior Office action. 

Claims 1-10, 13-21, and 24-26 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Abbasi, US 6,786,863, in viewof Yee, US 6,016,385, and in further 
view of Biocca, US 2002/0080094. 
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Abbasi describes a remote plnysical contact system and metliod wlierein a 
camera is coupled to a first surrogate, the camera capturing an image of a first, physical 
location in which the surrogate is disposed (camera 35A, element 160, location of user 
10), and producing a first video image signal from the first captured image (video Figure 
5, column 2, lines 54-58); a processor that receives the first video image signal (Figure 
5, column 2, lines 54-58), an adapter to send the first video image signal to a 
communications network (computer 15, Figures 1 and 5) and receive a second, video 
image signal from the communication network (Figure 5), the second video image signal 
of a second, different physical location (camera 35B, element 165, location of user 20); 
and a display to display the second video image of the second, different physical 
location (display of computer 15). Abbasi further describes the surrogate having tactile 
sensors positioned along the exterior of the surrogate, the sensors sending first tactile 
signals to the communications network (figure 4); a body suit having tactile actuators, 
the tactile actuators receiving second tactile signals from the communications network 
(column 6, lines 17-42); motion sensors positioned throughout the body suit (Figure 3), 
the motion sensors sending first motion signals corresponding to movements of each 
sensor relative to a reference point (column 5, lines 28-45), the first motion signals 
transmitted to the communications network (Figure 5); and wherein the surrogate is a 
first surrogate (Figure 1). Abbasi describes a second surrogate at a second location 
(surrogate 165), the second surrogate receiving, from the communications network 
(Figure 5), the first motion signals from the motion sensors (column 6, lines 17-42), the 
first motion signals from the motion sensors causing a movement of the second 
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surrogate that is correlated to a movement of tine body suit (column 6, lines 17-42). 
Abbasi further describing that the second surrogate includes motion actuators 
corresponding to the motion sensors (Figure 4), the motion actuators causing the 
second surrogate to move (column 5, lines 28-45). Abbasi further describes wherein the 
second surrogate comprises a microphone coupled to the second surrogate 
(microphone 40B), the microphone for sending audio signals (Figure 5), corresponding 
to sounds in the second physical location (Figure 1), to the communications network 
(network 30); a first microphone coupled to the first surrogate (microphone 40A); a 
second surrogate in the second location, the second surrogate supporting a second 
microphone and a second camera (Figure 1, elements 40B, 35B); and a second display 
in the second location to receive the first video image signals (display of computer 25) 
and a second speaker to receive the audio signals form the first microphone (element 
458). 

Abbasi further describes a first communication gateway in the first location 
(computer 15); a second processor in the second location to process video from the 
second location (computer 25); and a second communication gateway in the second 
location (Figure 1 ), the second processor connected to the first processor via the 
communication network (computer network 30). 

Abbasi does not describe morphing the captured video image and does not 
describe wherein the displays are a set of goggles or explicitly that the surrogate is a 
humanoid robot. 
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However, Yee teaches a remotely controlled robot by an operator reacting to 
feedback signals originating at the robot, the robot (second location surrogate) is a 
humanoid robot (Figure 3); a camera coupled to the robot, capturing an image of a first, 
physical location (cameras 22, figure 1) and a set of goggles to display the second 
video image of the second, different physical location (element 24, column 5, lines 11- 
37); the robot having tactile sensors positioned along the exterior of the robot (column 7, 
lines 49-58) that are transmitted to the operator that have tactile actuators that receive 
tactile signals (column 4, lines 5-8 and column 8, lines 10-15). Yee further teaches 
wherein the robot comprises a body (element 34); a microphone coupled to the body, 
the microphone for sending audio signals (column 4, line 51 -column 5, line 10), 
corresponding to sounds in the second physical location, to the communications 
network (column 4, line 51 -column 5, line 10); wherein the set of goggles further include 
a transducer to render the audio signals, received from the communication network, 
corresponding to the sounds in the second physical location (column 5, lines 1-10, 
figure 1 ); wherein the set of goggles, comprising a wireless receiver to wirelessly 
receive the video image (column 9, lines 9-11); and wherein the robot comprises a 
transmitter to wirelessly send the audio signals, the tactile signals, the motion signals 
and the video image to the communications network (column 9, lines 9-11). 

It would have been obvious to one of ordinary skill in the robotic and 
communications arts to combine the inventions of Abbasi in view of Yee because as 
Abbasi suggests the remote communication would be enhanced with the inclusion of 
tactile or other physical stimulus from one human user to another, which "enables 
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people to expand on the notion of teleconferencing or computer communications by 
adding a capability to engage in all types of physical contact" (column 1 , lines 60-63). 
Further Abbas! describes that the surrogate can be "any anatomical component" 
(column 2, lines 3-4) to create contact messages to reflect the physical state of the 
surrogate, therefore it would have been further obvious to one of ordinary skill in the 
robotic field to use the remote robotic control system of Yee, because the robot Yee 
teaches would allow the operator to sense the same environment the robot is in (column 
1, lines 20-27). 

Neither Abbasi nor Yee describe that the image acquired by the camera but do 
not describe wherein the image is morphed or overlays the image on a virtual scene. 
However, Biocca teaches a teleportal system to provide remote communication to a 
plurality of users, wherein a processor that receives a first video image signal, morphs 
the first video image signal and sends the morphed image signal to a second, physical 
location to be displayed ([0037]), wherein the display is integrated with the set of 
goggles (integrated with the headset of the user, [0045], [0050]); and wherein the 
processor overlays a virtual environment over one or more portions of the video image 
to form a virtual scene (figures 13 and 14, [0045], [0050]). It would have been obvious to 
one of ordinary skill in the robotic and communication arts, to morph the acquired image 
because as Biocca suggests, morphing the image and overlaying the image allows the 
image to be perceived in a user preferred 3D or stereoscopic view that gives a more 
realistic view of the second location ([0038]-[0039]). Biocca teaches that it is an obvious 
variation to project the image on lens or displays coupled to the headgear, thus allowing 
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the user to move outdoors ([0044], [0051]). Further it would have been very obvious to 
one of ordinary skill in the communication arts to duplicate the morphing process at the 
second location to send the first location, this would have provided the predictable result 
of the stereoscopic or overlaid view as taught by Biocca, and the duplication is 
suggested by Abbasi's description of enhanced communication. 

Claim Rejections - 35 USC § 103 

Claims 11, 12, 22, and 23 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Abbasi in view of Yee and Biocca as applied to claims 7 and 20 
above, and further in view of Simmons, US 2003/0030397. 

Abbasi in view of Yee and Biocca describe the system and method of a virtual 
reality encounter system as applied previously. Neither Abbasi, Yee, nor Biocca teach 
that the body of the robot includes that the cameras are positioned in the eye sockets 
and the microphone of the robot is positioned in the ear canal. However, Simmons 
teaches a system and method of controlling a robot remotely, wherein the robot is a 
humanoid robot (figure 5); the robot includes an eye socket and the camera is 
positioned in the eye socket ([0026]); and the robot includes an ear canal wherein the 
microphone is positioned in the ear canal ([0016]). It would have been obvious to one of 
ordinary skill in the art to combine the invention of Abbasi in view of Yee and Biocca 
with the teachings of Simmons because as Simmons suggest, placing the sensors in 
the position corresponding to the human sensors aligns the sensors to the perspective 
of the use and better reflects the environment to the perspective of the user ([0026]) 
thereby giving a more realistic perception. 
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Conclusion 

Any inquiry concerning this communication or earlier communications from tine 
examiner should be directed to CHRISTINE M. BEHNCKE whose telephone number is 
(571)272-8103. The examiner can normally be reached on 8:30 am- 5pm. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Thomas G. Black can be reached on (571) 272-6956. The fax phone 
number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/C. M. B./ 

Examiner, Art Unit 3661 



/Thomas G. Black/ 

Supervisory Patent Examiner, Art Unit 3661 



